Situated Delegation-Oriented Multimodal Presentation in SmartKom

نویسندگان

  • Jochen Müller
  • Peter Poller
  • Valentin Tschernomas
چکیده

One of the major scientific goals of SmartKom is to design a new human-machine interaction metaphor for a multimodal dialog system that combines speech, gesture, and mimics input with speech, gesture and graphics output. The system behavior is based on the new situated delegation-oriented dialog paradigm (SDDP) in the sense that a communication assistant, realized as an animated life-like character, serves as the communication partner of the user. In this paper we focus on the multimodal output of SmartKom, showing how these highly ambitious tasks of the SmartKom system are managed and realized on the output side, i.e., how the communication assistant adapts its behavior to the available output media and modalities with respect to the current dialog situation.

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Smartkom: multimodal communication with a life- like character

SmartKom is a multimodal dialog system that combines speech, gesture, and mimics input and output. Spontaneous speech understanding is combined with the video-based recognition of natural gestures. One of the major scientific goals of SmartKom is to design new computational methods for the seamless integration and mutual disambiguation of multimodal input and output on a semantic and pragmatic ...

متن کامل

SmartKom: Towards Multimodal Dialogues with Anthropomorphic Interface Agents

SmartKom is a multimodal dialogue system that combines speech, gesture, and facial expressions for input and output. SmartKom provides an anthropomorphic and affective user interface through its personification of an interface agent. Understanding of spontaneous speech is combined with video-based recognition of natural gestures and facial expressions. One of the major scientific goals of Smart...

متن کامل

Mobile Multimodal Dialogue Systems

Mobile multimodal dialogue systems allow the user and the system to adapt their choice of input and output modality according to various technical and cognitive resource limitations and the task at hand. We present the multimodal dialogue system SmartKom, that can be used as mobile travel companion for car drivers and pedestrians. SmartKom combines speech, gestures, and facial expressions for i...

متن کامل

An Exemplary Interaction with SmartKom

The different instantiations of the SmartKom demonstration system offer a broad range of application functions and sophisticated dialogue capabilities. We provide a first look at the final SmartKom prototype from the point of view of the end user. In particular, a typical interaction sequence will be presented in order to illustrate the functionality of the integrated multimodal dialogue system.

متن کامل

The SmartKom Architecture: A Framework for Multimodal Dialogue Systems

SmartKom provides an adaptive and reusable dialogue shell for multimodal interaction, which has been employed successfully to realize fully-fledged prototype systems for various application scenarios. Taking the perspective of system architects, we will give a review of the overall design and specific architecture framework being applied within SmartKom. The basic design principles underlying o...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2003